Dissociating task difficulty from incongruence in face-voice emotion integration

Dissociating task difficulty from incongruence in face-voice emotion integration

In the everyday environment, affective information is conveyed by both the face and the voice. Studies have demonstrated that a concurrently presented voice can alter the way that an emotional face expression is perceived, and vice versa, leading to emotional conflict if the information in the two modalities is mismatched. Additionally, evidence suggests that incongruence of emotional valence a...

Dissociating working memory from task difficulty in human prefrontal cortex.

A functional magnetic resonance imaging (fMRI) study was conducted to determine whether prefrontal cortex (PFC) increases activity in working memory (WM) tasks as a specific result of the demands placed on WM, or to other processes affected by the greater difficulty of such tasks. Increased activity in dorsolateral PFC (DLPFC) was observed during task conditions that placed demands on active ma...

Emotion recognition from expressions in face, voice, and body: the Multimodal Emotion Recognition Test (MERT).

Emotion recognition ability has been identified as a central component of emotional competence. We describe the development of an instrument that objectively measures this ability on the basis of actor portrayals of dynamic expressions of 10 emotions (2 variants each for 5 emotion families), operationalized as recognition accuracy in 4 presentation modes combining the visual and auditory sense ...

Integration of Face and Voice Recognition

cepstral features and features based on a bio–mechanical model of the visible articulators will be the identity–carrying characteristics extracted from acoustic speech and visual speech respectively. Speakers will be modelled by multi–layer perceptrons trained as discriminative models or, alternatively, as predictive models. In the discriminative modelling scheme, each speaker model will be tra...

Emotion Recognition in the Human Face and Voice